Papers with few-shot approaches
Exploiting Language Model Prompts Using Similarity Measures: A Case Study on the Word-in-Context Task (2022.acl-short)
Copied to clipboard
| Challenge: | Existing few-shot approaches fail on the semantic distinction task of the Word-in-Context dataset. |
| Approach: | They propose a prompt-based approach which boosts few-shot performance to the level of fully supervised methods by using similarity metrics. |
| Outcome: | The proposed technique boosts few-shot performance to the level of fully supervised methods. |
Towards more equitable question answering systems: How much more data do you need? (2021.acl-short)
Copied to clipboard
| Challenge: | Question answering datasets in English are relatively new, but lack of linguistic diversity in the field is a challenge. |
| Approach: | They propose to use translation and cross-lingual transfer to produce QA systems in multiple languages to improve their performance. |
| Outcome: | The proposed approaches take advantage of existing resources to produce QA systems in multiple languages. |
CrisiText: A dataset of warning messages for LLM training in emergency communication (2026.findings-eacl)
Copied to clipboard
| Challenge: | Identifying threats and mitigating their potential damage during crisis situations is paramount for safeguarding endangered individuals. |
| Approach: | They present a large-scale dataset for the generation of warning messages across 13 different types of crisis scenarios. |
| Outcome: | The proposed dataset contains more than 400,000 warning messages (spanning almost 18,000 crisis situations) aimed at assisting civilians during and after such events. |
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters (2021.acl-long)
Copied to clipboard
| Challenge: | Few-shot crosslingual transfer outperforms zero-shot with pretrained encoders like multilingual BERT. |
| Approach: | They conduct an experimental study on 40 sets of sampled few shots for six diverse NLP tasks across up to 40 languages. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on lexical features and a full model finetuning approach outperformed several state- of-the art approaches. |
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing open-domain QA tasks focus on questions whose answer can be deduced directly from global factual knowledge. |
| Approach: | They propose a dataset where each question is based on a counterfactual presupposition via an "if" clause. |
| Outcome: | The IfQA dataset contains 3,800 questions that were annotated by crowdworkers on relevant Wikipedia passages. |
Language Models for Text Classification: Is In-Context Learning Enough? (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing research on text classification models with prompts is limited in scale and lacks understanding of how these methods compare to more established methods. |
| Approach: | They compare the performance of large and smaller language models with prompts to achieve state-of-the-art performance in many NLP tasks. |
| Outcome: | The proposed models outperform the more standard approaches in binary, multiclass, and multilabel tasks in a large scale evaluation of 16 text classification datasets. |
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models . |
| Approach: | They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses . |
| Outcome: | The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets. |